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Field of the Invention 

5 

The present invention relates to an apparatus and a 
method for partially transmitting high-resolution and high- 
volume JPEG (Joint Photographic Experts Group) image as well 
as a computer-based recording medium for recording the program 
10 to embody the method; and, more particularly, to an apparatus 
and a method for transmitting the images not by sending the 
entire data but part of them needed for display only in image 
data transmission, thus reducing the amount of transmission 
and shortening waiting time. 

15 

Description of the Prior Art 

A patent related to shortening waiting time in image data 
transmission is U.S. Patent No. 125211, listed on Sep 26, 2000, 
20 in which waiting time is shortened by transmitting the entire 
image data successively in order of frequency bands. 

In connection with a method reducing the amount of data 
transmission, there is U.S. Patent No. 4996594, listed on Feb 
26, 2000, in which data are transmitted one by one of dynamic 
25 regions and the amount of transmission gets reduced by sending 
out data different from the previous frames. 

The image transmission techniques in the conventional 



1 



network usually concern ones for transmitting common 
resolution images, which is being mostly used at present. 
Hereafter, when the use of network application service 
increases the demand for quality service of high-resolution 
and high-volume image will rise, too. But the current 
technology is not proper to the transmission of high- 
resolution and high-volume image. 

The shortcomings of the conventional technology are set 
forth in detail hereinafter. 

The image format most frequently used today is JPEG. 
This is because JPEG prides the superior ratio of compression 
index to picture quality. 

As one of JPEG compression methods, there is progressive 
method, used for network transmission, in which image data are 
divided according to their frequency bands and sent out in 
order successively to their frequency band, not the whole data 
sent at a time when JPEG image are transmitted on a network. 
The progressive method has been highlighted in the early days 
of the low-speed internet, a technology in which low-frequency 
band data are transmitted first, followed by intermediate 
frequency data and then high frequency data, thus showing 
outline image first by using the first arrived low frequency 
band data, then showing more detailed image added to the low 
frequency data image with the data arriving the next in order. 
In the early days of the Internet, with low speed, people had 
to wait long time to see all image data arrive and be shown on 
a web browser. In that Internet environment of the early days, 



employing the progressive JPEG technique, Netscape web browser 
got a rave review by showing the outline data first while 
downloading image data, which gave users the choice of to wait 
or not to wait according to their interest, thus shortening 
5 the waiting time drastically. 

At present, however, with information infrastructure and 
investment in networks around the world, the Internet speed 
has improved remarkably. Now the progressive technique has 
become out of date because network speed has become fast 
10 enough to maintain QoS (Quality of Service) even when entire 
JPEG image is transmitted at a time. But, in the future 
environment of high-quality service, the current way of 
transmitting whole data will not be proper because the amount 
of image will be very big. It's also improper to make use of 
15 the progressive method as in the early days of the Internet. 

Due to the development of network and computer technology, 
image data transmission has become a frequent job. Users 
craving for quality service, the demand for high-resolution 
and high-volume images increases. Lack of demand for the 
20 high-resolution and high-volume image at present, the 
technology on it still leaves much to be desired. Soon, the 
transmission of high-resolution and high-volume image will be 
more frequent. Thus, a method for transmitting such images is 
necessarily required. 

25 
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Summary of the Invention 



It is, therefore, an object of the present invention to 
provide a partial image transmission apparatus and a method 

5 for transmitting data only needed for the display on an client 
not sending out the entire image in image data transmission, 
thereby maintaining the QoS, as well as a computer-based 
recording medium for recording a program to embody the method. 

In accordance with an embodiment of the present invention, 

10 there is provided an apparatus for partially transmitting 
image data on a network, comprising: first storage means for 
storing partial-region-accessible image file; second storage 
means for storing information, which is offset & partial 
region access information, needed to generate partial region 

15 image; first communication processing means for receiving 
request for partial region image from a client and 
transmitting the partial region image requested to the client; 
and image partial access processing means for extracting the 
corresponding offset & partial access information, accessing 

20 the corresponding image file stored in the first storage means 
and generating the partial region image based on the extracted 
offset & partial region access information, and transmitting 
the generated partial region image to the first communication 
processing means, in accordance with the request of a partial 

25 region image file from the first communication processing 
means . 

In accordance with another embodiment of the present 
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invention, there is provided a method for partially 
transmitting image data on a network, the method comprising 
the steps of: a) when a server registers an image in its DB, 
converging the image file to a partial-region-accessible file 

5 and storing it and generating information needed for 
generating partial-region image, which is offset & partial 
region access information; b) when a client requests partial 
region image, the server accesses the corresponding image file, 
which is stored, based on the offset & partial region access 

10 information; and c) transmitting the generated partial region 
image to the client. 

In accordance with an embodiment of the present invention, 
there is provided a computer-based recoding medium for 
recording a program to embody the method transmitting partial 

15 image on a network, the functions of: a) when registering an 
image in a server, converting and storing the image file to a 
partial-region-accessible file and storing, and generating 
information needed to generate partial region image in this 
procedure; b) when requested for partial region image from a 

20 client, having a server access to the corresponding image file, 
which is stored in, based on the offset & partial access 
information and generating the partial region image; and c) 
transmitting the generated partial region image above to the 
client . 

25 
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Brief Description of the Drawings 



The above and other objects and features of the present 
invention will become apparent from the following description 
5 of the preferred embodiments given in conjunction with the 
accompanying drawings, in which: 

Fig. 1 shows a configuration of a network service system 
joined with an image partial transmission apparatus in an 
embodiment of the present invention; 
10 Fig. 2 is a detailed flow chart illustrating the process 

of converting a common JPEG into a partial-accessible JPEG in 
the image partial transmission method of the present 
invention ; 

Fig. 3 is a detailed flow chart depicting the process of 
15 DRI modification of Fig. 2 in an embodiment of the present 
invention; 

Fig. 4 is a detailed flow chart showing the MUC decoding 
and procedures of Fig. 2 in an embodiment of the present 
invention ; 

20 Fig. 5 illustrates a detailed flow chart of the component 

processing of Fig. 4 in an embodiment of the present 
invention ; 

Fig. 6 is a detailed flow chart depicting the substitute- 
encoding procedure for the original DC value of Fig. 5; 
25 Fig. 7 is a detailed flow chart describing the process 

for the display region partial request in the image partial 
transmission method of the present invention; 
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Fig. 8 is a detailed flow chart illustrating the JPEG 
file generation procedure in the request region of Fig. 7 in 
an embodiment of the present invention; and 

Fig. 9 shows a configuration diagram of a partial JPEG 
5 image corresponding to a requested region in an embodiment of 
the present invention. 

Detailed Description of the Preferred Embodiments 

10 Other objects and aspects of the invention will become 

apparent from the following description of the embodiments 
with reference to the accompanying drawings, which is set 
forth hereinafter. 

The present invention concerns maintaining the QoS of 
15 image data by transmitting data only needed for display on a 
client not sending out the entire image data. 

The present invention presents an image transmission 
technology for future high-quality image service, and JPEG 
image, currently the most popular format on the Internet, is 
20 the object of an embodiment of the invention. 

In order to take full advantage of a JPEG image, in this 
embodiment of the present invention a method of transmitting 
images in a complete JPEG format when to send out part of 
image data needed for display only. For this, JPEG data are 
25 modified suitable for network transmission so that necessary 
part of the data can be selectively transmitted when requested 
The demand for high-quality network service of high- 
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resolution and high-volume image is on the rise. So, a new 
technology is required for the transmission of it, as the 
conventional skills are not suitable. 

The amount of high-resolution and high-volume image data 

5 is enormous. To help understanding, the original data size of 
a 24 bit color image of red, green and blue 10,000-pixel long 
and 10,000-pixel high is 286MB, which takes 229.94 seconds to 
transmit at lOMbpps, the general transmission speed of the 
current LAN (Local Area Network) systems. If this image is 

10 compressed into a JPEG format, it can be shrunken into a 
twentieth of the original size, which is still 14.3MB taking 
11.4 seconds to be transmitted at a speed of lOMbpps. As you 
can see, with the conventional technology, it's hard to 
provide a service of high-resolution and high-volume image 

15 data on the current network systems. So, to develop a method 
for transmitting such high-resolution and high-volume image 
data on network systems is the purpose of the present 
invention . 

To address the problems mentioned above, this invention 
20 paid attention to below points. 

The image data a user can see at once is restricted by 
the resolution of his display device. For instance, if the 
resolution of a user's monitor is 1,000 x 1,000 and the one of 
a high-volume image data to see is 10,000 x 10,000, the user 
25 comes to see as much part as 1,000 x 1,000, a hundredth of the 
whole data, due to restriction of the resolution his monitor 
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can afford to display. 

So, the user has to scroll the screen up and down, right 
and left to see the data. That is, no matter how big an image 
data is a user should see only as much as the resolution of 
5 his monitor from the entire image. In this case, the user has 
a total of 10,000 x 10,000 images, but there is little 
difference with having an image of 1,000 x 1,000. In short, 
the part of data not shown at this moment is unnecessary. 
Therefore, transmission time can be shortened remarkably by 
10 not transmitting the unnecessary data, which is not displayed. 

Secondly, a case where display region is scrolled and 
changed will be explained. 

When display region is scrolled and changed, in case a 
local hard drive has the entire data, the corresponding data 
15 is loaded from the local hard drive to the memory of the 
display device, thus renewing display. Here, when the local 
hard drive has only part of the entire data, the data for 
renewing display is requested to a server and loaded from the 
server hard drive to the memory of the display device. 
20 The difference between the two methods is the time for 

data loading. The latter takes longer time loading data. But 
the difference will not be a problem to users as long as they 
can bear the loading time of the latter method. Paying 
attention to this point, when transmitting high-resolution and 
25 high-volume image data on a network the waiting time of a user 
can be shortened by sending part of the data needed to display 
only on a monitor. And when the image needs to be scrolled 
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and renewed and it can be transmitted within a time users can 
bear, serving the method will be feasible. This method is 
applicable to the present networks. For instance, the size of 
a JPEG image 1024 x 768 XGA, which is most used currently is 
5 around 110KB. It takes about 0.1 second to transmit at a 
speed of 10Mbps. It's a time users can wait and also 
sufficient time to do scrolling as 10 pieces of data can be 
sent for a second. That is, using a method of sending as much 
data necessary for display on a client in serving high- 
10 resolution and high-volume image data on a network, this 
method is applicable to the current network environments. In 
order to serve the method, JPEG processing system for partial 
transmission of JPEG image is in need, which will be described 
in this invention hereinafter. 
15 First of all, a technology for accessing necessary part 

of JPEG data is needed to transmit part of JPEG. For this, a 
method of converting the present JPEG into JPEG with its DRI 
(Define Restart Interval) of 1 has been developed. JPEG with 
the DRI of 1 can decode each MCU (Minimum Coded Unit) 
20 independently and also it's possible to access data by the 
unit of MCU and to take out the data. In this procedure of 
conversion, offset tables for managing location information of 
each MCU and information for partial access to JPEG are 
generated. 

25 When a client requests for part of data for display, a 

server takes out the necessary data only from the converted 
JPEG by using the offset tables and the information for 
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partial access, adds information and JPEG header for the data 
and sends them to the client. Here, the necessary information 
is sent in a complete JPEG form. The reason is to minimize 
work for the use in the conventional web browser. That is, 
5 all need to be added to the present web browsers is just a 
simple control for sending data necessary for scrolling and 
display. 

Fig. 1 shows a configuration of an embodiment of a 
network service system joined with an image partial 
10 transmission apparatus in accordance with the present 
invention . 

The network service system consists of a client 10, a 
device for requesting image partial transmission, and a server 
20, a device for image partial transmission. To briefly 

15 explain the operation of the service of this system, the 
client 10 sends a message, marked region partial request 
message, of requesting for part of data necessary for display 
to the server 2 0 and the server 2 0 receives the message and 
composes the necessary part of the data into the JPEG format, 

20 marked region partial JPEG, and sends it to the client 10. 

To take a look at the composition of the server 20, the 
image partial transmission device, it comprises an image 
database 24 for storing partial-region-accessible image files; 
an offset and partial access information database 2 3 for 

25 storing information to generate partial region image file, 
offset & partial image access information; a server 
communication processor 21 for being requested for partial 
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region image file, marked region partial request, and 
transmitting the requested partial region image file, marked 
region partial JPEG, to the client 10; a JPEG partial access 
processor 22 for extracting the corresponding offset & partial 
5 access information from the offset and partial access 
information database 2 3 according to the partial region image 
request, marked region partial request, from the server 
communication processor 21, and generating partial region 
image, marked region partial JPEG, by accessing the 
10 corresponding file stored in the image database based on the 
extracted offset & partial region access information. 

Also, the client 10 includes a scroll controller 12 for 
interpreting the scroll data inputted by a user and ordering 
and controlling the new region to display; a display 
15 controller 11, for requesting partial region image to display 
the new region, marked region partial request, and controlling 
the new marked region partial image to display, marked region 
partial JPEG, under the control of the scroll controller 12; a 
client communication processor 14, for transmitting partial 
20 region image request, marked region partial request, from the 
display controller 11, receiving the partial region image, 
marked region partial JPEG, from the server communication 
processor 21; and a JPEG decoder 13 for decoding the partial 
region image, marked region partial JPEG, transmitted from the 
25 client communication processor 14 and transmitting it to the 
display controller 11. 

First of all, the composition and function of the client 
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10 will be described. 

The client 10 largely includes a display controller 11, a 

scroll controller 12, a JPEG decoder 13 and a client 

communication processor 14. 
5 To take a look at how the client of this composition 

operates, first a user makes use of the scroll controller 12 

to browse image. Here, the scroll controller 12 interprets 

the scroll information inputted by the user and displays a new 

region of image to the display controller 11. 
10 Then, the display controller 11 has the client 

communication processor 14 send a message requesting necessary 

part of image to the server 20 to display the requested region. 
Subsequently, in response to this message, the client 

communication processor 14 receives the JPEG data 
15 corresponding to the new display region from the server 2 0 and 

transmits it to the JPEG decoder 13. 

Then, the JPEG decoder 13 decodes and passes the data to 

the display controller 11. When the display controller 

displays the data all the work for the user's scroll order 
20 finishes, the client 10 waiting for another order from the 

user . 

Now, the composition and operation of the server 20 will 
be explained. 

The server 2 0 is largely composed of four parts: a server 
25 communication processor 21, a JPEG partial access processor 22, 
an offset & partial access information database 23 and an 
image database 24. 
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To take a look at how the server 20 operates, the server 
2 0 operates according to marked region partial request message 
from the client 10. 

The server communication processor 21 interprets this 
5 message and transmits it to the JPEG partial access processor 
22 . 

Then, the JPEG partial access processor 22 requests 
information needed for generating partial region JPEG to the 
offset & partial access information database 23 and brings it 

10 on. Using this information, the image database 2 4 accesses 
the corresponding data and generates partial region JPEG, and 
after the generation of JPEG corresponding to the part of the 
marked region request, it has the server communication 
processor 21 transmit the JPEG data to the client 10. 

15 After that, the server communication processor 21 

transmits the JPEG data to the client 10, finishing the work 
for the request message of the client 10, the server 20 being 
set in condition of waiting for another request from the 
client 10. 

20 In order to provide the service of Fig. 1, referring to 

Fig. 2, the procedure of converting JPEG into partial- 
accessible JPEG will be explained more in detail. This 
converting procedure is executed when a new image is 
registered in the image database 24 of the server 20. 

25 Input JPEG files are converted into partial-accessible 

output files and registered in the image database 24, while 
the generated offset information and information for partial 
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access are generated during the conversion procedure, the 
generated information which is registered in the offset & 
partial access information database 23. 

Referring to Fig. 2, to describe the procedure of 
5 converting into partial-accessible JPEG, first at step 201, a 
conversion work file and a memory are prepared. In this 
procedure, an input JPEG file is opened, a converted JPEG file 
that supports partial access and an output JPEG file are 
generated and a memory for offset information is assigned. 
10 Then, the converted JPEG file is decoded to the scan 

header and then copied and recorded in the output file, the 
target file. Here, the DC (Direct Current) tables of Huffman 
table are replaced with standard tables and recorded. And, at 
step 202, offset location information of the JPEG file to the 
15 scan header is stored in offset information. This is because 
when partial region JPEG is made at later steps, the JPEG 
files are copied and used to the scan header. 

Subsequently, at step 203, the DRI of the target file is 
changed. For the target file to access partially, all MCU 
20 should be independent. For this, DRI should be defined to be 
1, meaning all MCUs are independent. This procedure of 
changing DRI is illustrated in Fig. 3. 

Referring to Fig. 3 and taking a look at the procedure of 
DRI change at step 203, it is determined whether the DRI is 
25 defined in input JPEG at step 301 as there can be cases where 
the DRI is or is not defined in the input JPEG; in case of DRI 
defined the DRI already copied into the target file is 
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modified at step 302; in case of DRI not defined a DRI marker 
segment is generated, inserted in front of the scan header of 
the target file; and the offset location information to the 
scan header is modified at step 303. 
5 After the procedure of DRI modification, MCU decoding & 

processing is carried out at step 204. This is done for all 
MCUs unit by unit. The decoding & processing procedure for a 
single MCU is shown in Fig. 4. 

Referring to Fig. 4 and taking a look at the decoding & 

10 processing procedure for a single MCU at step 204, this 
processing is conducted N-times , N being the number of 
components included in the scan. These components in baseline 
JPEG are brightness Y , color difference information from blue 
Cb and color difference information from red Cr, thus N=3 . 

15 Conducting the component processing (see Fig. 5) N-times 

at steps 4 02 and 403 and doing the work of Restart (RST) 
marker insertion at step 404, the MCU decoding & processing 
procedure of step 204 finishes. The RST marker insertion is a 
work of inserting the RST marker to the target file by 

20 calculating and inserting the number of RST marker thereto. 

Referring to Fig. 5 and taking a look at the procedure of 
component processing of step 403 of Fig. 4, component 
information, DC (Direct Current) and AC (Alternative Current) 
buffer are prepared at step 501. Here, the component 

25 information is the index number of DC and AC Huffman table 
needed for decoding and the number of block corresponding to 
the component in MCU. The DC buffer is a memory to store DC 
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data, which is encoded by using the standard Huffman DC table, 
while the AC buffer is a buffer to store the AC data, which is 
encoded by the original JPEG Huffman. The AC coefficient is 
copied and stored in the AC buffer as it is, because it was 
5 not changed in the overall modification process. 

Then, DC and AC Huffman tables corresponding to the 
numeral order of a Huffman table and the standard Huffman DC 
table for encoding the DC are prepared at step 502. 

Subsequently, after the preparation of tables, steps 503 
10 to 508 are conducted for the N number of blocks. 

In this work for the blocks, difference information DIFF 
is obtained first by decoding the DC. This decoded DIFF is 
the difference from the previous DC. Adding the previous DC 
to this DC, the value of the original DC can be obtained at 
15 step 505, which is illustrated in Fig. 6. 

Referring to Fig. 6 and taking a look at the procedure of 
the original DC value substitute encoding, the step 506, when 
J=l, the original DC coefficient D is encoded by using the 
standard DC table at steps 601 and 602. For the other cases, 
20 the decoded DC Coefficient DIFF is encoded by using the 
standard table at steps 601 and 603. 

Then, the encoded DC is updated in the DC buffer at step 

604. 

In the meantime, after finishing the procedure of the 
25 original DC substitute encoding, AC coefficient gets decoded 
at step 507. Here, the AC coefficient is decoded in order to 
know where the AC data of this block begins and finishes in 
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the original JPEG file. And, at step 507, the data part of 
the AC coefficient obtained by decoding it is copied to the AC 
buffer as they are. 

Subsequently, the DC buffer is copied to the target file 
5 prior to the AC buffer, which should also be copied to it, and 
a process for one block is finalized at step 508. 

Performing this procedure N-times, the component 
processing finishes. 

Fig. 7 shows the process of generating JPEG files 
10 corresponding to the region requested by the JPEG partial 
access processor 22 when the marked region partial request 
message is transmitted to the server 20. 

At step 701, when the marked region partial request 
message is transmitted from the client 10 to the server 20, 
15 the JPEG partial access processor 22 first loads the necessary 
information from the offset & partial access information 
database 23. This information concerns the location of the 
file to its scan header, information of MCU composition and 
information of each MCU offset. 
20 Then, at step 702, it is checked if the region requested 

is a valid region, that is, it is checked if the region is 
accessible from the original image, and if it is a valid 
region the MBR (Minimum Boundary Rectangle) including the 
region is calculated. Here, the reason calculating MBR is 
25 that JPEG can access by the unit of MCU. That is, a square 
region in the unit of MCU, which includes the requested region 
is obtained. For instance, when H and V of all components of 
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MCU are 1 , that is, in case each component includes a single 
block, one MCU corresponds to information 8-pixel long and 8- 
pixel high. Here, when the requested region is (50, 50) to 
(250, 250), the region of (48, 48) to (255, 255) is brought, 

5 as the access should be done by the unit of MCU. That is, the 
accessible minimum unit is the MCU size. Therefore, the MCU 
unit including the requested region is calculated. 

After that, at step 703, requested region JPEG file is 
generated. The procedure of generating the requested JPEG 

10 file of step 703 is illustrated in Fig. 8, and the structure 
of the requested region JPEG file, which is generated, is 
shown in Fig. 9. 

Referring to Fig. 8 and taking a look at the procedure of 
generating requested region JPEG file of step 703, the JPEG 

15 file is copied up to the scan header at step 801. 

Then, at step 802, the X and Y of a frame header are 
modified into the width and height of the MBR calculated and 
obtained at the step 702. What has been generated here so far 
is shown in Fig. 9A. 

20 Subsequently, at step 803, MCUs corresponding to MBR are 

brought and recorded in the generated file, and an RST marker 
is inserted. What is generated by this step is seen in Fig. 
9B. 

Finally, EOI (end of image) marker is recorded. What is 
25 generated by this step is in Fig. 9C. 

At step 704, the JPEG file generated through the above 
steps is transmitted to the client 10, and the generation of 



19 



requested region partial JPEG terminates. 

The method of the present invention mentioned above can 
be embodied in a form of a program and recorded in recording 
media such as CD roms , RAMs , ROMs , floppy disks, hard disks, 
5 optical-magnetic disks and the like. 

As shown above, the present invention has following 
effects . 

First, when browsing high-resolution and high-volume 
image on a network, the present invention shortens the user 

10 waiting time and enables to serve high-resolution and high- 
volume image data in the current network environment by 
transmitting part of the data necessary for display alone. 

Secondly, the present invention is available in the 
present browsers by transmitting the necessary part of the 

15 whole image data in a complete JPEG format, when sending the 
part of the data. 

Thirdly, the present invention relieves a client from the 
burden of lacking space for storage and of operation. To 
process high-volume image data, a storage device with high- 

20 capacity and a high-performance operation device are required. 
Moreover, it takes considerable time to load image to a 
graphic memory of a client. In this method of the present 
invention, in which a necessary part of an image data is sent 
to a client, with small amount of data to be processed, the 

25 time for loading data to the graphic memory can be shortened 
and the memory space of a storage device is saved as well. 

While the present invention has been described with 
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respect to certain preferred embodiments, it will be apparent 
to those skilled in the art that various changes and 
modifications may be made without departing from the scope of 
the invention as defined in the following claims. 
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